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ABSTRACT 

s 

Because therp is a need to measure performance of puoils with complex 
concepts, the Slide Sorting Task was developed to measure performance on 
complex concepts of freedom, non-freedom, justice, non-justice. The develop- 
ment of this instrument was presented along with the\results of item analyses 
with several groups of £s ranging frcnn age seven through adults. The utility < 
of the instrument was shown as a^ means of differentiating instructional pro- 
cedures similar to those in regular classro«ns. The instrument vias shown 
to differentiate performances of abstract and concrete thinkers and to 
produce improved performances as a function of increases in age level. 
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THE DEVELOPMENT OP A MEASURE OF COMPLEX CONCEPTS 

Many teachers are concerned about the learner's acquisition of concepts 
in school settings. They are concerned about the types and kinds of concepts 
to be learned, the ways in which different learners acouire concepts, and 
the different strategies that might be employed to facilitate the acquisition 
of concepts. A number of teachers are aware of the vast and diverse research 
literatar^ that has accumulated. Much of this literature is based upon the 
attainment of coniuctive and disjuctive concepts which are formed with ^ 
combinations of color, shape, size, number, and types of borders. While 
the relationships that are defined in this manner are important for the 
researcher, these combinations of attributes are not the typical kinds of 
concepts taught by teachers in their classrooms. A striking exception, of 
course, would be the uni-dimensional concepts ccwmonly taught to young 
children, such as the color, red, or the shape, triangle. 

Although there are studies incorporating Piagetian tasks and research 
studies that have used concepts that are similar or identical to the types of 
concepts taught in the schools, for example, Atkin (1961), Johnson (1^64), 
King (1963), Nelson (1958), and Olson (1963) , there is a need to develop 
conceptual learning tasks that are more congruent with the kinds of concepts 
taught in the schools. Thus, a number of complex concepts that have lonq 
been incorporated in the curricula of the schools need to be studied if the 
research efforts are to have greater applicability for the classroom teacher. 
The three principal purposes for this oapor are to: 

1. Present a descrintive narrative of the develooment of an instrument 
to measure th^ complex concepts identified as freedom, non-freedom, 
lustice, and injustice* 
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2. Present descriptive data relative to pupil performance on the instru- 
ment at various aqe levels identified as seven, eiqht, nine, ten, 

^ eleven, twelve, thirteen,^ fourteen, seventeen, and eiqhteen year olds 

as well as adults. 

3. Present the findings of two research studies that have used the instru- 
ment or a modified form of the instrument. 

0 \ 

'^^^ Inst rument 

Early developinental efforts of the concept leaminq task which incorporated 
the complex concepts of justice, nonjustice, freedom, and nonfreedom led to 
the identification of a larqe poal of exemplars for each of the five con- 
ceptual cateqories. initially a pool of seventy eiqht 35mm slides was 

established. These seventy eiqht slides were then given to a qroun of three 

\ 

raters to sort into the five cateqories. Ml three raters agreed on the classi- 
fication of thirty three slides while two of the three raters agreed on the 
placement of twenty nine of the slides. The other sixteen slides were discarded. 
To the twenty nine slides selectjed by two of the three raters as identifyinq 
the concept, a set of fifty six newly developed slides were added. The original 

thirty three unanimously agreed upon slides and the pool of eighty five slides ^ 

• were given a second sorting in which three additional raters were added makinq 
a total of six raters for the set of one hundred eiqhteen si ides ^ 

The second screeninq, in which no slide was used v^ich received aqreement 
from fewer than five of the six raters, produced forty seven slides. From 
these forty seven slides, the forty which varied most within each category were 
selected to comprise the set of exemplars for the five complex concepts. 

In order to provide subjects who resrvsnded to this instrument and an orienta- 
tion to the task and to provide a consistent system for the administration of the 
instrument, a J5et of instruction:* was developed which provides example exemplars 
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for the concepts of nonfreedom, irrelevant, and justice. Specific instruc- 
tions for administration of the instrument were: 

"In vour school experience you often hear the concepts (or ideas) 
of justice and freedom or their opposites, non justice, and nonfreedom. 
This study in which you are participating is designed to find out 
how well students of your grade level understand what is meant oy 
justice and freedom or non justice and nonfreedom. 

You will be shown a set of slides that represent these concepcs or 
ideas. When each slide is shown on the screen you are to decide 
which of these ideas it best represents and mark an X in the column 
headed by that concept of idea. If a slide picture does not fit 
any concept of idea, you are to mark an X in the last column." 



"Yes, the giraffes in the pen represent the concept of nonfreedom 
and you should place an X under the column marked nonfreedom." 

"Let/'s trv one more." 

T?roject slide B (irrelevant) 

Ask: "What category does this slide best fit?" 

"Yes, the man on the moon's surface does not fit any concept or 
idea so you should have marked an X in the last cojumn v,'iich reads 
•noes not fit anv conr>r^.;t * \ 




Let us try one now» 



ft 



Project slide A (nonfreedom) 



Ask: '*What category does this slide best fit? 
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"NOW, a final example I" 

A, 

Project slide C (justice) 

Ask: "Wliat cateqory does this slide best fit?" 

I 

"Yes, the picture of the lady weiqhinq her produce purchase renresents 
justice/ so vou should have marked an X in the column labelled justice," 

"Are there anv Questions?" 

"MOW we are ready to see the slides. You will be shown 40 slides 

and vou are to mark the category where each one best fits. You 

will be given adequate time to decide in. which cateqory you wish 

to place each slide. If you need more time^ please raise your 

hand or speak out. Otherwise, you are not to talk durinq this study." 
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A further refinement of the Slide Sortinq Task (SST)* was done by George 
(1973) following an item analysis (see Table 1) based on the responses of 
suhjects'in the Meinke, Georqe, and Wilkinson study (1973). Eiqht slides 
which discriminated neqatively were Miscarded, Three slides which failed to 
discriminate were removed from the set and used as exemplars in the instruc- 
tional treatment condition? of her study since over 95 percent of the subjects 
had aqreed upon their classification. Another pool of fifty-two n^w slides 
was developed by her and submitted to a panel of "expert" raters. Aqain# 
only the twenty-seven slides which were aqreed upon by five of the six raters 
as denotinq the concept were included in the group from which the thirteen 
new slides were chosen to complete the set. The slides selected were chosen 
because they varied most within a particular cateqory. 



*A complete description o"^ the stinuli is available from the authors 
uoon request. 
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development of the SST only three exemplars, one each 
of justice, nonfreedom, and irrelevant, were used for instructional purposes. 
They were chosen from slides which all raters had agreed upon as represent incf 
that concept. Two of the three exemplars, justice and nonfreedom, were 
retained as instructional exemplars for the later study. The irrelevant 
exemplar was not used. Also, two of the three slides, freedom, and non- 
freedom, which failed to discriminate in the original study were used as 
instructional exemplars. The third of these three slides was also an exemplar 
§f nonfreedom but was eliminated as an instructibnal exemplar because it was 
similar to the other nonfreedom slide but had a higher discrimination index. 

The four remaining instructional exemplar slides were chosen from the 
pool of exemplars. They were selected because ^ in* addition to having received 
unanimous agreement from raters, they were judged to have the greatest varia-- 
tion from others in that particular category. 

The study by George (1973) using the refined SST instrument to investi- 
gate the- effect of different modes of instruction on eighth graders* abilitv 
to acquire these complex concepts yielded a reliability coefficient of .73 
between original scores and delay scores after one week. When a reliability 
coefficient was computed according to the Kuder-T^ichardson formula twenty 
technique, a .82 reliability coefficient was obtained. 

Perfo rmanc e nata 

The first form of instrument was administered to four hundred twenty" 
seven respondents of varying ages from seven through fourteen, seventeen and 
eighteen, and a group of adults. The means and standard deviations for each 
of these aae groups are shown in Table 2. it can be seen that there is a 
progressive increase in performance across age grouos throuqh aq^ thirteen. 
At age fourteen and eighteen the means were lower than the mean at age 
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thirteen. The hicher trend in means continued for age seventeen and adults. 
It appears /then, that increases in performance with aqe begin to level off 

at age thirteen and above. ^ 

Although the individual concepts selected for this instrument can be 
classified as complex concepts, it, is interesting to examine performances 
within age groups on each of the specific concepts. In Table 3 the means for 
each concept are shown'^ across all W levels. A brief inspection of the table 
reveals that younger children, ages seven through twelve, perform better on 
the concepts of freedom and nonfreedom than thev do on luatice or injustice. 
From age thirteen and above performance of respondents appears to.be highly 
similar across concepts. 

Research Data 

The first study by Meinke, George, and Wilkinson (1973) employed the 
first version of the instrument to test the effects of grade level; fourth, 
sixth, and eighth, of sex, boys and girls, and of levels of thinking, abstract 
versus concrete. They found a significant effect for grade level (F - 14.42, 
d.f. - 2, p < .01) and a significant effect for type of thinker (F - 9.00, 
d.f. - 1, p<.01). There were no significant effects found for sex or for 
any of the interactions. Performance on the complex concepts task increased 
as a function of grade level and abstract thinkers performed significantly 
better than concrete thinkers. 

The second study bv George (1973) used the revised version of the instru- 
ment, in her study she compared performances on the complex concept task of 
students who were identified as concrete or abstract thinkers when thev were 
given different modes of instruction. She found significant effects for tvpe 
of thinking (F = 11.40, d.f. - 1, P < PD and for mode of instructions 
(P « 4.72, d.f. = 4, P ^ .-a). Abstract thinkers performed significantly 

8 / 



better than concrete thinkers. Students who were provided instructions where 
neqativ^ instances were followed by positive instances* with ifistructor speci- 
fication of the releivant attributes of each exemplar performed significantly 
better than students in the control qroup who received no instructions. There 
was no significant interaction effect. 

S iuwnary -and Conclusions 

This study has presented the development and refinement procedures used 
to produce an instrument to measure performance of students on c<»nplex concepts. 
The refined form of the instrument yields a reliability coefficient of .73 and 
.83 when using a delay score and the Kuder-Richardson formula 20, resnectively. 
Additional data were provided to show performances of students at ages se^^en 

through fourteen, seventeen and eighteen, and adults. A trend of incre^ed 

/ 

performance with age was noted. Finally, both forms of the instrument/ have 
been used in research, studies which have produced significant effects for 

type of thinker, grade levels of students, and mode of instructions. 

^ > 

This instrtiment is a valuable and practical tool for measuring pupil 
performance on complex concepts similar to those taught in the schools. 
Further, it provides a means for continued investigation of instructional 

strategies designed to enhance performance with complex concepts. The instru-- 

i 

ment tests the effects of instructions using a media cQimnonly used in the 
teaching environment. 
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TABLE 1 



Item Analysis of Slide Sor^ilnq Task 


Slide 


Difficulty 


ltem-<-Total 


Slide 


Difficulty Item-Total 


# 


{% right) 


Correlations 


# 


(% riqht) Correlations 


1 


53^ 


28 


21 


64 


57 


2 


73 


49 1 


22 


73 


45 


3 


49 


28 


23 


' 54 


55 


4 


61 


33 


24 


25 


5 


68 


58 


25 


75 


24 


6 


40 


26 \ 


26 


74 


47 


7 


56 


38 


I 27 


66 


29 


8 


64 


55 


\ 28 


\ 53 


17 


9 


66 


30 


\ 29 


80 


61 


10 


64 


30 


\ ^° 


56 




11 


84 ,/ 


35 


\ 31 


51 


42 


12 


64 / 


45 


\ 32 


46 


23 


13 


78 


34 


' 33 ■• 


78 


42 


14 


54 


45 


^ 34 


89 


68 


15 


89 


38 


35 


55 


39 


16 


83 


44 


\ 


51 


11 


17, 


49 


\ 15 « 


\ 37 


55 1 


20 


18 r 


26 


^ 01 


38 


86 


25 


19 


79 ■ 


21 


39 


81 


42 


20 


79 


46 


40 


58 ! 


24 



11 
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TABLE 3 

Means for Specific Concepts by Aqe Group 





Concepts 


Aqe Group 

/ i — 


Freedom 


Non-Freedom 


Justice 


Non- Justice 


Irrelevant 


Seven ! 


4.13 


* 5 . 71 


1.19 


..90 


0.52 


Eight 


4.09 


5.78 


1.84 


1.03 


1.34 


/ Nine 


3.88 ^ 


6.34 


3.03 


2-06 


2.56 


Ten 


4.15 


' 6.79 


4.04 


1.96 


2.40 


Eleven 


4.51 


6.41 


4.68 


2.59 


2.51 


Twelve 


4.92 


6.75 


5.25 


4.53 ^ 


3.97 


Thirteen 


t Cm 

5.54 


6.65 


6«24 


5, 33 


6. 00 


Fourteen 


5.22 


6.57 


X 5.91 


5.39 


5.17 


Seventeen 


5.95 


6.05 


6.38 


5.84 


6.04 


Eighteen 


5.44 


5.88 


5.94 


6.00 


5.56 


Adults 


6.31 


6.86 


6. 86 


5.64 


6.4R 
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